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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
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- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
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2a)Q This action is FINAL. 2b)[3 This action is non-final. 
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closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
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* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 

2) [U Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) IZ] Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 



4) □ Interview Summary (PTO-413) 

■ Paper No(s)/Mail Date. . 

5) Notice of Informal Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mail Date 20070620 



Application/Control Number: 10/693,163 Page 2 

Art Unit: 2165 

DETAILED ACTION 
Continued Examination Under 37 CFR LI 14 

1. A request for continued examination under 37 CFR LI 14, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 4- June - 
2007 has been entered. 

2. The amendment filed on 4-June -2007 has been received and entered. Claim 37 is 
pending. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claim 37 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sigurionsson et al. (U.S. Pub. No. 2002/0107829 Al) in view of Kobus Barnard and 
David Forsyth . Learning the Semantics of Words and Pictures, IEEE 2001 (From hereon 
in Barnard et al. ). 



As to claim 37, Sigurionsson et al. discloses a method comprising: 
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obtaining one stored images wherein the one or more stored images are stored 
within an image database, wherein the stored images are associated with at least one of a 
multiplicity of keywords (See page 3, paragraph 0030); 

obtaining an image and comparing the image to the stored images to identify one 
or more similar images wherein image similarity is based on at least two factors, wherein 
one of the at least two factors is closeness in time of image acquisition (See Figure 9A) 
and wherein another one of the at least two factors is determined using a content based 
image retrieval module (See page 3, paragraph 0037); 

producing at least two primary keywords based on the keywords associated with 
the similar images (See page 4, paragraphs 0042-0047); 

determining at least two primary associations with the primary keywords (See 
page 3, paragraph 0037); 

producing at least two secondary associations that identify at least two finer scale 
keywords wherein the secondary associations are based on the keyword and the primary 
associations wherein the database indicate that the finer scale keywords are keywords that 
are associated and occur when at least one of the primary keywords occurs (See page 3, 
paragraph 0037, and see page 4, paragraphs 0045-0046); 

presenting the primary keywords, the finer scale keywords, and a new keyword 
selection to a user (See page 4, paragraph 0048); 

obtaining one or more accepted keywords from the user wherein the accepted 
keywords comprise any one of or combination of primary keywords, the finer scale 
keywords, and one or more new keywords entered via the new keyword selection (See 
page 4, paragraphs 0049-0050); and 
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storing the image within the image database and in association with the accepted 
keywords (See page 3, paragraph 0038); and 

updating the keyword wherein the keywords further comprise the accepted 
keywords (See page 4, paragraph 0048). 

Sigurionsson et al. does not explicitly teach the association of tags to be statistical 
as claimed to be wherein a multitude of keyword statistics are stored in a database 
statistics module, and wherein the keyword statistics indicate a probability that one of the 
keywords is associated with the one of the stored images whenever another one of the 
keywords is associated with the same stored image; likelihoods of keywords; and 
updating the keyword statistics. Sigurionsson et al. teaches multiple tags (keywords) 
associated with an image and with each other (See page 4, paragraph 0047); and updating 
the keyword database (See page 4 5 paragraph 0048). 

Barnard et al. teaches wherein a multitude of keyword statistics are stored in a 
database statistics module, and wherein the keyword statistics indicate a probability that 
one of the keywords is associated with the one of the stored images whenever another 
one of the keywords is associated with the same stored image (See page 412, column 2); 
and 

likelihoods of keywords (See page 413); 

updating the keyword statistics (See page 414, column 2). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to modify the teachings of Sigurionsson et al. with the teachings of 
Barnard et al. to include association of multiple keywords in the same category (i.e. 
primary scale, finer scale) using statistics and likelihood of occurrence as it allows for 
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faster automated classification of images for better search as taught in Barnard et al. page 
408, column 1. 

Response to Arguments 

5. Applicant's arguments with respect to claim 37 have been considered but are moot 
in view of the new ground(s) of rejection. 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. See PTO-Form 892 for list of cited references. 



7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Neveen Abel-Jalil whose telephone number is 571-272- 
4074. The examiner can normally be reached on 8:30AM-5: 30PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Gaffin can be reached on 571-272-4146. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
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Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




Neveen Abel-Jalil 
June 25, 2007 



